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- The MAILING DATE of this communication appears on the cover sheet with the correspondence address -- 
Period for Reply 

A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 

- If NO period for reply is specified above, the maximum statutory period will apply and will expire SIX (6) MONTHS from the mailing date of this communication. 

- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 U.S.C. § 133). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 

Status 

1 M Responsive to communication(s) filed on 11/29/01:3/5/02:4/30/02:6/18/03 . 
2a)D This action is FINAL. 2b)M This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1935 CD. 11, 453 O.G. 213. 

Disposition of Claims 

4) I3 Claim(s) 1-31 is/are pending in the application. 

4a) Of the above claim(s) is/are withdrawn from consideration. 

5) D Claim(s) is/are allowed. 

6) E3 Claim(s) 1-31 is/are rejected. 

7) D Claim(s) is/are objected to. 

8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 

9) H The specification is objected to by the Examiner. 

10) [3 The drawing(s) filed on 05 March 2002 is/are: a)K accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 
Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 

1 1) D The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 

Priority under 35 U.S.C. § 119 

12) D Acknowledgment is made of a claim for foreign priority under 35 U.S.C. § 119(a)-(d) or (f). 
a)D All b)D Some * c)D None of: 

1 .□ Certified copies of the priority documents have been received. 

2.D Certified copies of the priority documents have been received in Application No. . 



3.D Copies of the certified copies of the priority documents have been received in this National Stage 
application from the International Bureau (PCT Rule 17.2(a)). 
See the attached detailed Office action for a list of the certified copies not received. 
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DETAILED ACTION 



Claim Rejections - 35 USC §102 

1 . The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

2. Claims 1-20 and 22-3 1 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Johnson et al. ("A method for direct audio search with applications to indexing and retrieval"). 

Re claim 1, Johnson et al. disclose a method of matching (abstract) sequences of 
signals from an information stream (audio stream in abstract) comprising: extracting 
(right column page 1427 lines 1-3 from 2.1 Background section) a stream of samples 
from a subject information stream, each of the extracted samples (right column page 1427 
lines 1-3 from 2. 1 Background section which contain audio samples) comprising a 
portion of the information stream, computing, for each of the samples, a vector quantity 
indicative of the data in the sample (right column page 1427 lines 4-8 from 2. 1 
Background section); correlating (right column page 1427 line 13 from 2. 1 Background 
section) the vectors to generate a signature indicative of the stream of samples; 
comparing (left column page 1427 third paragraph from Introduction section as to 
compare the result with the cue-audio) the generated signatures to signatures generated 
from a match stream of samples; and generating, as a result of the comparing, a distance 
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matrix indicative of signatures generated from similar samples (left column page 1428 
second paragraph). 

Re claim 2, Johnson et al. further disclose a correlating includes generating the 
signature distinctively from signatures generated for other streams of samples (abstract 
wherein each segment has unique signature). 

Re claim 3, Johnson et al. further disclose the correlating generates a covariance 
matrix as a signature indicative of the stream of samples (left column page 1428 in 
Search Method section). 

Re claim 4, Johnson et al. further disclose arranging the samples into a plurality of 
segments (left column page 1428 second paragraph). 

Re claim 5, Johnson et al. further disclose each of the extracted samples 
comprises a predetermined internal of the subject information stream (right column page 
1427 first paragraph in Background section). 

Re claim 6, Johnson et al. further disclose the match stream is the extracted 
stream of samples itself (left column page 1428 fourth paragraph in Search Method 
section). 

Re claim 7, Johnson et al. further disclose the match stream is indicative of a 
predetermined sequence of samples stored from previously transmitted samples (left 
column in page 1428 second paragraph). 

Re claim 8, Johnson et al. further disclose signatures corresponding to the 
predetermined sequence are stored in a library (abstract inherently). 
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Re claim 9, Johnson et al. disclose a method of detecting repetitions in an 
information stream (abstract) comprising: providing (right column page 1427 first 
paragraph under Background section) an information stream of multimedia data 
corresponding to a transmitted signal; extracting (right column page 1427 first paragraph 
under Background section lines 2-3) a plurality of samples from the information stream; 
accumulating (right column page 1427 first paragraph under Background section lines 5- 
8) the samples into segments comprising a predetermined interval of the transmitted 
signal; generating (right column page 1427 first paragraph under Background section 
lines 9-10) respective vectors indicative of the samples in each of the segments; for each 
segment, correlating (right column page 1427 first paragraph under Background section 
line 13) the vectors in the segments to generate a respective covariance matrix 
-corresponding to-the segment; aggregating (right column in page 1428. under Search _ 
Method section) each of the covariance matrices corresponding to the segments into a 
sequence of covariance matrices; and comparing (right column in page 1428 second 
paragraph) each of the covariance matrices in the sequence with each other covariance 
matrix in the sequence to generate a distance matrix. 

Re claim 10, Johnson et al. further disclose generating the distance matrix further 
comprises generating a distance value, indicative of the similarity between the distance 
matrices, as a result of the comparing (right column in page 1428 second paragraph). 

Re claim 11, Johnson et al. further disclose traversing the distance matrix to 
determine similar sequences of covariance matrices (right column in page 1428 second 
paragraph). 
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Re claim 12, Johnson et al. further disclose determining similar sequences further 
comprises searching for diagonals of similar distance values (right column in page 1428 
third paragraph under Search Method section). 

Re claim 13, Johnson et al. further disclose searching for diagonals of similar 
distance values includes searching for distance values within a predetermined threshold 
(right column in page 1428 under Search Method section). 

Re claim 14, Johnson et al. further disclose the covariance matrices correspond to 
a multidimensional space and comparing the covariance matrices further comprises: 
determining, for each of the covariance matrices, a location in the multidimensional space 
(D-dimensions vector space); and computing a distance value indicative of the distance 
between the covariance matrices in the multidimensional space (right column in page 
1428 under Search Method section). - 

Re claim 1 5, Johnson et al. further disclose ranking the distance values and 
storing the ranking in the distance matrix (right column second paragraph page 1428). 

Re claim 16, Johnson et al. further disclose a matching sequence is determined by 
similar diagonal values in the distance matrix (right column in page 1428 third paragraph 
under Search Method section). 

Re claim 17, Johnson et al. further disclose the similar diagonal values form a 
contiguous sequence for a predetermined number of locations in the distance matrix 
(right column in page 1428 third paragraph under Search Method section). 
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Re claim 1 8, Johnson et al. further disclose the multidimensional space further 
comprises at least dimensions (D-dimension vector space in right column third paragraph 
under the Search Method section page 1428). 

Re claim 19, Johnson et al. further disclose the information stream further 
comprises streaming audio (abstract with audio) or video. 

Re claim 20, Johnson et al. further disclose traversing the distance matrix to 
determine if a similar distance value sequence is found (left column page 1427 third 
paragraph under Introduction section); querying, when a similar distance value sequence 
is found in the distance matrix, a library of previously found distance value sequences; 
storing the distance value sequence in the library if a match is not found as a result of the 
querying (right column page 1427 second paragraph lines 10-17); and updating, if a 

match is found as a result of the querying, a timestamp corresponding to the matching 

distance value sequence in the library (right column page 1427 second paragraph). 

Re claim 22, it is a system claim of claim 1 . Thus, claim 22 is also rejected under 
the same rationale as cited in the rejection of rejected claim 1 . 

Re claim 23, it is a system claim of claim 2. Thus, claim 23 is also rejected under 
the same rationale as cited in the rejection of rejected claim 2. 

Re claim 24, it is a system claim of claim 3. Thus, claim 24 is also rejected under 
the same rationale as cited in the rejection of rejected claim 3. 

Re claim 25, it is a system claim of claim 5. Thus, claim 25 is also rejected under 
the same rationale as cited in the rejection of rejected claim 5. 
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Re claim 26, it is a system claim of claim 6. Thus, claim 26 is also rejected under 
the same rationale as cited in the rejection of rejected claim 6. 

Re claim 27, it is a system claim of claim 7. Thus, claim 27 is also rejected under 
the same rationale as cited in the rejection of rejected claim 7. 

Re claim 28, it is a system claim of claim 8. Thus, claim 28 is also rejected under 
the same rationale as cited in the rejection of rejected claim 8. 

Re claim 29, it is a computer product claim of claim 1 . Thus, claim 29 is also 
rejected under the same rationale as cited in the rejection of rejected claim 1 . 

Re claim 30, it is a computer data signal including program code claim of claim 1 . 
Thus, claim 30 is also rejected under the same rationale as cited in the rejection of 
rejected claim 1 . 

~ "" Re 'claim" 31, it is a system claim of claim 9. Thus, claim 3 -1- is also rejected under 
the same rationale as cited in the rejection of rejected claim 9. 

Claim Rejections - 35 USC § 103 

3. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

4. Claim 21 is rejected under 35 U.S.C. 103(a) as being obvious over Johnson et al. ("A 
method for direct audio search with applications to indexing and retrieval"), as applied to claim 1 
above, in view of Ngo et al. (U.S. 5,694,474). 
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Re claim 21, Johnson et al. further disclose traversing the distance value 
sequences in the library examining each of the timestamps of the distance value 
sequences (right column page 1427 second paragraph). Johnson et al. do not disclose the 
step of surging, when the timestamp is beyond a predetermined threshold; the distance 
value sequence corresponding to the timestamp. However, Ngo et al. disclose in the 
abstract a concept of deleting a value beyond a predetermined threshold (lines 18-21). 
Therefore, it would have been obvious application to a person having ordinary skill in the 
art at the time the invention is made to add a step of surging the distance value sequence 
from the library when the timestamp is beyond a predetermined threshold as seen concept 
in Ngo et al.'s invention into Johnson et al. 's invention because it would enable to reduce 
the hardware storage (abstract lines 18-21). 

Conclusion 

5. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. 

a. U.S. Patent No. 5,3 13,556 to Parra discloses an acoustic method and apparatus for 
identifying human sonic sources. 

b. U.S. Patent No. 4,282,403 to Sakoe discloses a pattern recognition with a warping 
function decided for each reference pattern by the use of feature vector components of a 
few channels. 

c. U.S. Patent No. 4,843,562 to Kenyon et al. disclose a broadcast information 
classification system and method. 
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Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Chat C. Do whose telephone number is (703) 305-5655. The 
examiner can normally be reached on M => F from 7:00 AM to 4:30 PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Chaki Kakali can be reached on (703) 305-9662. The fax phone number for the 
organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system, see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
-system, contact the-Electronic Business Center-(-EBC) at 866-2 17-9 197- (toll-free)^ 
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